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AESTHETIC PROFILE COLLECTION 
Background 

This invention relates to electronic commerce on the 
Internet, and applied market research both on and off-line. 

The Internet has become a vehicle for buying products 
of all types. When shopping on the Internet, a buyer may search 
a database for products that have been catalogued by a particular 
style name. For example, if shopping for furniture, a shopper 
can ask for products that are classified as "Contemporary . " 
Similarly in clothing, a consumer may search by specifying 
multiple, objective criteria such as color and price range (e.g., 
blue shirts under $20) . The shopper would receive results 
listing shirts that matched the color and price specifications. 
The results could be very numerous and the shirts could be of 
very different styles, many of which may not appeal to the 
customer. The shirts could have nothing in common with each 
other, other than that they are blue and under $20. Searching 
for furniture products is generally done based on style name, 
e.g., "Traditional", "Contemporary", "Country", and so forth. 

Summary 

Style names do not have specific meanings, that is, 
there is no agreed upon meaning for what constitutes 
"Traditional" or "Contemporary" furniture. Styles are an attempt 
to assemble collections of aesthetic attributes into discrete 
sets, to distinguish styles from other styles, and therefore 
divide an entire category (e.g., furniture) into smaller 
searchable units. There can be considerable overlap between 
styles. A particular chair design might be considered 
"Contemporary", "Country", "Transitional", or "Shaker". Because 
there is no clear consensus as to what combination of material 
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and aesthetic attributes constitutes a particular style. A 
Contemporary light fixture for example, could be a simple glass 
piece or it could be a complicated fixture made out of wood and 
aluminum and other materials. Moreover, a simple light fixture 
5 could exist that includes Traditional and Contemporary elements. 
Shaker style is considered a Traditional style, but it also 
embodies simplicity which is characteristic of Contemporary 
style. This confusion is compounded since few consumers have 
specific knowledge as to what the various style names mean. 
10 Thus, styles and style names are not sufficiently accurate 

descriptors to allow consumers to easily identify furniture they 
would find appealing. 

On the Internet, product selection is often larger than 
in off-line stores, which are limited by the physical constraints 
;;f45 of their display space. The downside of Internet shopping is 
m that there may not be sufficient bandwidth (either transmission 

bandwidth or a user's continued attention span) to show many 
Q products very quickly. Thus, a customer is unlikely to see all 

J possible products that are available and which are desirable to 
i||20 the customer. Rather the customer would have to sort through a 
;5 large number of products. This is particularly true with an 

Internet based store that may sell products from many different 
vendors . 

One aspect of the invention is to provide a sorting 
25 technique that is based primarily on visual and aesthetic 
characteristics . 

According to an aspect of the present invention, a 
method for selecting products that occurs over a networked 
computer system includes retrieving a product aesthetic tag 
30 associated with a particular product type selected by a customer, 
the aesthetic tag containing values that represent aesthetic 
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features of the product and forming a result tag that contains a 
value corresponding to how well aesthetic features of the product 
match to aesthetic preferences of the customer. 

According to an additional aspect of the present 
5 invention, a computer program product residing on a computer 

readable medium for selecting products over a networked computer 
system includes instructions to cause a computer to retrieve a 
customer aesthetic profile, the customer aesthetic profile tag 
having aesthetic profile preferences of the customer, retrieve a 
10 product aesthetic tag associated with a particular product type 
selected by the customer that has aesthetic features of the 

r| product, compare customer aesthetic profile tag to the product 
aesthetic tag, and form a result tag that contains a value 

"*g corresponding to how well aesthetic features of the product match 

^15 to aesthetic preferences of the customer. 

Brief Description of the Drawings 
Q FIG. 1 is a block diagram of a networked computer 

;£* system including a server that executes a profile collection and 

product selection process. 
!S20 FIG. 2 is a flow chart showing a product selection 

process . 

FIG. 3 is a flow chart showing a process to obtain 
initial information for product selection. 

FIG. 4 is a flow chart showing a process for collecting 
25 aesthetic profile information of a customer. 

FIG. 5 is a flow chart showing details of a process to 
produce an aesthetic-based profile tag. 

FIG. 6 is a flow chart showing details of a matching 
process for product selection. 
30 FIG. 7 is a flow chart showing details of a matching 
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engine used in the search process of FIG. 5. 

FIG. 8 is a flow chart showing a coding process to code 
products with aesthetic-based tag identifiers. 

FIG. 9 is a flow chart showing a profile averaging 

process. 

FIG. 10 is a flow chart showing a profile updating 

process . 

FIG. 11-12 are flow charts showing a sales analysis 
process based on product aesthetic characteristics. 

FIG. 13 is a flow chart showing an alternative process 
for collecting aesthetic profile information of a customer. 

FIG. 14 is a diagram of a web page that depicts a 
graphical user interface adaptable for use in the processes of 
FIGS. 4 and 13. 



Detailed Description 
Referring now to FIG. 1, a system 10 for collecting 
aesthetic profile information and for selecting products based on 
matching aesthetic profile information to aesthetic 
characteristic of products is shown. The system 10 uses a public 
network such as the Internet 18, as shown. Other types of 
network arrangements such as an Intranet or a local or wide area 
network, and so forth can be used. The system 10 includes one or 
more client stations 12 running a web browser program 12a or 
equivalent interface. The clients 12 are coupled to the Internet 
18 and to vendor sites 18a-18b and/or a server 16. The server 16 
includes a storage medium 17 and has residing on the storage 
medium 17 an aesthetic profiling and search process 25. The 
aesthetic profiling and search process 25 includes a personal 
aesthetic profiler process 30 that can collect profile 
information of clients at client stations 12, an aesthetic based 
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product search and matching engine 70, and an aesthetic-based 
product tagging process 90. 

In particular, the personal aesthetic profiler process 
30 collects aesthetically-based profile information of clients, 
5 as will be described below. The product search and matching 

engine 70 searches for products that are tagged with aesthetic- 
based specifications that are based on aesthetic profile 
information collected by the tagging process 90. 

The product search and matching process 70 is shown 
10 residing on the server 16 but could reside on individual vendor 
sites 14a and 14b, as also shown. Thus, the product search and 
matching process 7 0 can be executed as an individual site-based 
yj service for searching external multiple vendor sites 14a and 14b 

]* or, alternatively, the process 70 can be run on individual vendor 

UJ15 sites to internally search the site 14a and 14b. In some 

embodiments, the vendor sites 14a and 14b represent different 
^ non-associated vendors, whereas in other embodiments the vendor 

p sites 14a, 14b can represent associated vendors. 

+ Referring now also to FIG . 2, the aesthetic profiling 

;j|20 and search process 25 has the client 12 access 25a the 
y intermediary web site 16. The intermediary web site 16 will 

send, in a conventional manner, a web page to the browser 12a in 
client system 12 to gather 25b initial, objective profile 
information. The web page will have fields for the client to 
25 fill-in initial profile information such as name, address and 

general, objective, non-aesthetic-based product preferences, as 
is further described in conjunction with FIG. 3. 

After gathering initial profile information, the server 
16 will initiate 25c an aesthetics profiling session with the 
30 user at client system 12 if current aesthetic profile information 
is not available for the current user. The aesthetic profile 
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collection session collects aesthetic preferences of the 
individual at station 12 based upon aesthetic considerations 
related to various scales of form, texture, materials type and 
color, pattern, type and extent of decoration, overall product 
appearance e.g., presentation and others that are determined for 
each user by scoring a user's response to questions posed by 
viewing and grading images that are presented to the user. A 
technique for conducting this profiling session is described 
below in conjunction with FIG. 4. 

After the aesthetic profile is generated or retrieved, 
the process 25 searches 25d available products based on the 
initial and aesthetic profile information. Aesthetic information 
on available products are stored in a database (not shown) that 
is accessed by the server 16. The entries are aesthetic-based 
product characteristic tags that are produced in accordance with 
aesthetic considerations that are attributable to the product, as 
will also be described below. The search process 25d also has a 
matching process that enables the user's aesthetic profile to be 
matched against possible tags associated with products that are 
available on the system 10. These potential matches are returned 
by the server 16 and displayed 25e at the client station 12 
through the web browser 12a by returning a web page containing 
the results of the matching operation. 

The displayed results, if returned from the server 16, 
as in the embodiment under consideration, can include links 25f 
to the vendor sites 14a, 14b that sell the product, and 
preferably to the page at which the product is displayed at the 
vendor site. This would also lead to additional pages where the 
user can find additional information about the product or 
purchase the product at the vendor site. Alternatively, the 
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server 16 can provide that software service for the vendor and 
allow the client to directly purchase one or more products from 
the server site 16. 

Referring now to FIG. 3, an initial profiling process 
24 used to collect initial, objective, non-aesthetic profile 
information of the individual at client station 12 is shown. The 
profile session 24 collects information such as the identity 24a 
of the individual at the client station, information concerning 
the item that the client desires to search for 24b, as well as 
information regarding a price range 24c that the client is 
willing to accept, whether the client has any particular vendor 
or brand preferences 24d, as well as whether the client is 
concerned about availability for the product selected 24e. 

Depending upon the nature of the product, certain of 
these profile questions need not be asked of the individual. For 
example, if the items being searched for are related to 
furniture, possibly the vendor or branding of the furniture can 
be disregarded since there is generally less brand loyalty to 
furniture compared to brand loyalty commonly associated with 
clothing, for example. With clothing, the availability profile 
information can be avoided since clothing is generally available; 
whereas, with furniture, the availability of furniture may vary 
from weeks to months depending upon the vendor. Of course, all 
of these questions and additional, objective, non-aesthetic-based 
questions can be asked of the individual at this time. 

Referring now to FIG. 4, an aesthetic profiling process 
30 is shown. The aesthetic profiling process 30 obtains 
information regarding aesthetic preferences of a customer. The 
aesthetic profiling process 30 conducts testing of an 
individual's aesthetic preferences by having an individual 
examine selected set of images. The images are chosen or 
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constructed to highlight one of a plurality of aesthetic scales 
that are rated by the process 30. The process 30 starts by an 
individual examining 32 an initial set of images. The set of 
images are chosen to emphasize a particular aesthetic scale as 
5 well as a sub-scale within each of these scales as described 

below. The user examines the initial set of images and indicates 
its preferences for likes and dislikes of the aesthetic set by 
grading the images on a preference scale. The responses are sent 
to and received 34 by the server 16. The server process 30 
10 determines 36 whether a threshold number of exemplary sets of 

images have been examined by the user. If the threshold has not 
r| been reached, the server analyzes 38 the responses to determine a 

tfl new set of images to send to the client. 

Analysis 38 examines the results received from the user 
;^15 to determine whether the user has given consistent responses to 
ijl the styles being tested over the set of images. For example, if 

l;:y the set of images test the user's preferences for shape, the 

Q analysis process 38 examines the responses for shape to determine 

;IJ whether the user had consistent responses over the set of images. 

!jff20 If the responses are consistent, that is, if the user expresses a 
^ strong satisfaction for or a dissatisfaction with a particular 

shape scale, then the analysis process 38 can select additional 
sets of images that do not test for the particular style, e.g., 
shape. In this way, the analysis process narrows down the scales 
25 to those scales which require further testing of the user. The 
server 16 selects 39 a new set of images based on the analysis 
process 38. 

If the threshold has been reached, the server 16 will 
send 40 a test set of images which are selected to test whether 
30 the analysis process 38 can predict the user's answers for the 
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response. That is, whether the process has sufficiently learned 
the aesthetic preferences of the individual. Thus, the process 
30 will form 40 a test set of images and determine 42 a predicted 
response for each image in the test set of images. The process 
5 30 sends the images to the client where the client will again 
indicate its preferences. The server 16 will receive 44 the 
responses from the individual and compare 4 6 the responses 
received from the individual to the predicted responses for the 
individual. If there is an exact or sufficient match, the 

10 process 30 will form 50 a profile tag for the individual. If the 
answers do not sufficiently match, the process will submit 52 
additional sets of graphics for the user to examine and the 
process 30 will repeat until a second threshold is reached. 

The scales are several in number, e.g., 4 to 6 or more 

15 and the number of scales often are determined by the type of 
product. The scales are further divided into sub-scales, 
resulting in a total number of 10-12 or more scales. Exemplary 
scales and levels are shown in Table I below: 
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TABLE I 



Scale 


level A 


level B 


level C 


Form 


Closed, solid, dense 


Some solid, some open 


Open, not dense 


Form 


Curvy, organic 


Minimal curves 


Straight lines 


Form 


Simple, minimal parts 


Typical number of parts 


Complicated, many parts 


Materials 


Organic, natural 


Some natural, some manuf. 


Manufactured, machined look 


Decoration 


No decoration added 


Some decoration 


Highly decorated 


Decoration 


Inherent in form 


Inherent and added 


Separate from form 


Decoration 


Natural, organic 


Stylized, not symbolic 


Symbolic motif 


Overall 
Appearance 


Quiet, peaceful 


Somewhat attention-getting 


Loud, boisterous 


Overall 
Appearance 


Playful, humorous 


Not playful, not formal 


Formal, serious 


Overall 
Appearance 


Handmade, crafted 


Some handmade details 


Manufactured, no handmade parts 


Color 


Not colorful 


Somewhat colorful 


Very colorful 


Color 


Choose pallete 






Novelty 


Unique, unusual 


Some unique features 


Stylized, typical 



The major scale "Form" has three sub-scales. The sub- 
scales of "form" are related to preferences concerning "open - 
closed", "curvy - straight", "simple - complicated". The scale 
material relate to whether natural or manufactured appearance is 
desired. The major scale "Decoration" has three sub-scales used 
to specify whether or not there are "decorative elements" 
whether they are '"integral to the form or added to the form" and 
if decorative form is added the third sub-scale specifies whether 
the decoration is "a motif or a natural decoration". The scale 
"overall appearance" is used to give an overall sense of the 
product. Overall appearance has three sub-scales related to 
quiet-loudness of the overall appearance, playfulness - formality 
and handmade - manufactured appearance. "Color" scales test for 
color by using color palettes. The scales examine whether warm 
colors, cool colors, bright colors, soft colors, etc. appeal to 
the client. The scale "Novelty" relates to whether the product 
is consistent with the aesthetic norms for that type of product 
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(typical) or deviates from the norms (novel) . 

On each of these dichotomies there are three levels. 
For example, in form open and close there is open, closed, and 
in-between. Thus, for the scales, there are three levels. The 
5 customer can assigned a numeric value to each level of each 

scale. In some embodiments, the number values can be selected 
from a range of values, e.g., onto a scale of 1 to 10, for 
example, or can simply be a yes (like) no (dislike) . 

Each scale is represented by multiple archetype 
10 examples. The examples are product images whose primary 

aesthetic attribute is a best example of the particular scale, 
^ and that do not strongly embody attributes of other scales. For 

Ky instance, an archetype for the "solid form" scale could be a 
^ solid leather chair that has a fully enclosed seat and back. An 

UJ15 archetype for the open form scale could be a thin metal frame 
}fi chair with an open back and slat seat. The archetype for the 

intermediate level on the open-closed form scale could be a chair 
p with a solid seat but an open lattice back. 

% The process 30 uses multiple images of each scale to 

ij|20 conduct a test to make sure that there was not something 
^ objectionable about any particular image that was testing a 

particular scale. With 13 scales (scales and sub-scales) and 3 
levels (A, B, C) , there can be a total of 39 images that are 
tested. Since each tested scale can be run a number of times, 
25 e.g., three times, one such example could have a total of 117 
images. That is, there are three embodiments of each level of 
each scale. For example, three embodiments of a chair, an open 
chair, an intermediate open-closed chair and a closed chair. 
An example of another scale, e.g., decoration, has three levels. 
30 One level is decoration that is inherent in the design. For 

instance, a chair whose back, seat, and legs are made from one 
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continuos curved piece of metal has a decorative quality inherent 
in the form of the chair. The intermediate level of that scale 
could be a similar chair form that added a seat cushion and 
padded arms, thus introducing additional decorative elements to 
5 the basic form. The highest level of that particular scale of 
decoration could be a Queen Anne chair that would have many 
embellishments to the basic form including carved arms, legs, and 
back. 

Another sub-scale of the scale decoration is "motif." 
10 Motif refers to a pattern of carved or applied embellishment. 
Natural motifs are shapes and figures intended to be visually 
ri pleasing but not representing or symbolizing any particular 
; =Q meaning. The highest level of the "motif" scale are decorations 
If that have specific meaning and are references to a particular 

jjMLS symbol. For example, pineapples are used to symbolize 
m hospitality, or wheat staffs to symbolize abundance. These 
Fs - symbolic decorations are often closely linked to particular 

□ historical styles. Therefore, rather than labeling a particular 

piece of furniture as, for example, "traditional", the process 
Lff20 rates its various attributes according to the scales and 

sub-scales, to produce a more exact definition of the piece that 
allows for closer alignment with the preferences of the user. 

The test for furniture could only be images of chairs, 
because chairs embody all possible varieties of form and 
25 decoration of all furniture. Other items of furniture e.g., 
tables, sofas embody a more limited image. In the case of a 
chair, a chair allows for the most variation in a particular 
embodiment of that category. That is, when an individual is 
tested, the test can be comprised of images for a particular 
30 product, e.g., chairs that will represent a whole class, 

furniture. Of course, images of the particular products that a 
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client has selected could be used in the testing phase. 

For lighting, testing would use a table lamp because 
again it embodies all these characteristics of lamps. Some of 
the scales that are tested for in a table lamp may not present in 
track lighting. Testing using a table lamp will furnish 
sufficient information to select any type of lamp. The table 
lamp has a base, a body and a shade that captures more of the 
variations in lighting than would for example a sconce. 

Clothing, in addition to characteristics such as price 
and vendor, can include objective, non-aesthetic characteristic 
such as purpose, e.g., dress, casual or outdoor; material e.g., 
synthetics or natural fibers, nylon or rayon, cotton or wool. 
For each objective, non-aesthetic characteristic, the client can 
express no preference or could indicate a strong preference only 
for certain of these characteristics. When testing for clothing- 
based aesthetics, the testing process could test for shirts to 
represent the entire category of clothing. The testing would 
have the user respond to specific items such as a collar, a cuff, 
the manner in which the clothing hangs, whether the clothing is 
loose or tight, the transparency of the material. The process 
would test for both tangible and aesthetic attributes. 

After the user takes the profiling test, or at any 
other point when they are visiting the site, they can elect to 
view their profile. The viewed profile would appear as the table 
of scales for the given category (clothing, furniture) and the 
level "A", "B", or "C", that they had scored highest in 
highlighted. They could elect to edit their profile by 
highlighting a different level. This altered profile could be 
saved under a different name, or could be a change to their 
primary profile, at the users option. 
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Referring now to FIG. 5, a profile tag forming process 
60 takes 62 a numerical score that is assigned to each response 
and sums 64 that score with like scores from other responses of 
the user for the same scale. The summation of all of the scores 
or an average is entered 66 into a field of a vector that 
corresponds to the location of the scale in the profile tag. The 
profile tag can have a structure as shown below: 



form 


form 


form 


materials 


decoration 


decoration 


decoration 




ABC 


ABC 


ABC 


ABC 


ABC 


ABC 


ABC 



overall 


overall 


overall 


color 


color 


novelity 




ABC 


ABC 


ABC 


ABC 


ABC 


ABC 



The profile tag is formed by summing numerical scores 
that are assigned to each one of the scales tested in the profile 
process. For example, referring back to Table 1, the user can be 
shown images that tests the scale "form" that corresponds to 
whether the user likes solid or open shapes. The response could 
be a simple yes or no which assigns a value of e.g., 0 or 1, to 
each one of the levels presented for the scale form. These 
scales, over a series of images, e.g., 3 to 5 images, could be 
added up on a scale by scale basis and their sum can be used to 
represent the first form scale in the result vector. 

Alternatively, the customer can express a range of 
preferences for each scale such as by using a numerical scale, 
e.g., 1-10, Thus, each field would be populated with values in 
the range of 1 to 10 and those values would be added or averaged 
to produce a value for the profile tag. 
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Similarly, product tags will be formed in a similar 
manner using trained persons to grade the products and the 
product tags will have a similar structure. 

Referring now to FIG, 6, a search and matching engine 
70 that searches for products based on a customer aesthetic 
profile tag is shown. The process 70 retrieves 72 a customer 
aesthetic profile tag such as can be produced in accordance with 
the process shown in FIGS. 4 and 5. The process also retrieves 
74 all tags for a particular product type that were determined 
based upon the initial nonaesthetic profile information that the 
user submitted in conjunction with FIG. 3. The process finds 
matches 76 of the customer's aesthetic profile tag to aesthetic 
profile tags that are associated with products that are in the 
database accessible by the server 16. The matching engine 
retrieves 78 tags of the particular product type, to match to the 
profile tag of the user. Predetermined criteria are used to 
indicate what corresponds to a suitable match. The resulting 
tags can then be ordered 78 based upon the highest match score. 
The results can be used to retrieve 80 descriptions and images of 
the matched products and possibly the score that the product 
received. The results are sent 82 back to the user where they 
are displayed in the client web browser. 

Alternatively, the tags can be used to access links to 
other web sites where the products are offered. The scores as 
well as the links, or the links separately, can be sent back to 
the user so the user can actually examine the products that have 
been selected by the search process 70. 

Referring now to FIG. 7, the details of the matching 
process 76 (FIG. 6) are shown. The matching process 76 produces 
a score 76a for each corresponding field in a profile tag by 
comparing the value of the field in a profile tag to a value in a 
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corresponding field of the product tag to arrive at a value that 
indicates the relative agreement between the preferences of the 
individual and characteristics of the product. One technique 
could take the absolute value of the difference between both 
fields with ideally a difference of 0 corresponding to a perfect 
match, a difference of 1 corresponding to a near perfect match, 
and values greater than 1 to correspondingly successively poorer 
matches . 

The results are optionally weighted 76b by multiplying 
the score obtained in the scoring process 76a by a weight factor. 
The weight factors is either empirically determined or derived 
from prior knowledge of the aesthetic profile characteristics of 
the user. The matching process 7 6 thus can weight specific 
aesthetic attributes based upon either their relative importance 
to the particular product or based upon an inference that an 
individual does not have a particularly high concern for the 
particular aesthetic attribute. 

After weighting 76b the result, the result is stored 
76c in a corresponding field of a result tag. The process 
continues examining the fields of the client and product tags 
until all fields in the profile tags have been examined or 
compared against corresponding fields in the product tag. Once 
the process has finished for the products that are selected in 
the search process (FIG. 6), the results are sorted 78 as 
described above. 

Referring now to FIG. 8, a coding process to produce 
product tags that can be associated with products in the database 
is shown. The coding process 90 selects 92 an image of a product 
to score, and has a human scorer 94 score the product image 
according to predetermined parameters associated with each of the 
scale levels, as shown in Table 1 above, for the particular 
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product under consideration. 

A score is assigned indicating which level of each 
attribute the product embodies. In the case of Table 1, products 
would be scored "A", "B", or "C", in each of the thirteen scales. 
5 The statistics will be collected 98 and assembled into a code 

that corresponds to a tag for the product. The tag is stored 100 
along with a link to the product or other information associated 
with the product, so that the tag can be recalled when a 
particular type of product corresponding to the product being 
10 scored is selected by a user, such as described above in 
conjunction with FIGS. 2-7. 
^ Referring now to FIG. 9, a process 110 for merging 

y3 profiles from two different customers is shown. This process 
J 110, for example, can be used to allow two individuals such as a 

UJ15 husband and wife use their common preferences to search for a 
{ jp particular product such as, for example, by purchasing furniture 

^ where often more than one party is involved in the purchase. The 

p process will receive 112a the profile of customer 1, and retrieve 

;J: 112b the profile of customer 2. 

ifpO The process 110 can optionally weight 114a, 114b each 

^ one of the profiles by assigning a weight that can make one 

person's profile more prevalent over the other person's profile 
or optionally could be used to weight certain factors in the 
nonaesthetic profile generated in conjunction with FIG. 2 heavily 
25 towards one customer; whereas, weighting the aesthetic profile 
features of the process heavily towards the other customer. 
These weighting factors can be based on preferences stated by the 
users in queries or can be based on a model or the like. 

The optionally weighted profiles of both customers are 
30 combined 116 by averaging the values (weighted or unweighted) in 
each of the tags of the customers to come out with a new, 
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composite profile tag that corresponds to a composite of the 
individual profile tags. The new composite tag is stored 118 and 
is associated with both of the identities of the profile of the 
individuals whose profile was used. The composite profile tag is 
used to compare to tags of products in the product selection 
process described above. 

Referring now to FIG . 10, a process 120 for modifying 
an existing profile of a user which had previously used the 
system is shown. The user enters 122 non-aesthetic profile 
information such as the type of product the client wants to 
select as above. The process 120 determines 124 whether a profile 
has been completed for the user for the particular product 
category (e.g. furniture, or clothing) by examining all stored 
profiles for the user in the database which are also associated 
or tagged with products for which they were produced. If a 
profile has been completed, the process will exit. 

Otherwise, if the profile has not been completed, the 
profile is either updated 126 or a new profile is produced 
depending on the nature of the products and the nature of the 
stored profiles. If a new profile is produced the process of 
FIG. 4 is used again. If the profile is updated 126, the 
updating is accomplished by showing the user a subset of images 
especially selected from the set of images. These are examined 
using the process described above in FIG. 4. A new composite, 
profile is produced by concatenating or by selecting aspects of 
the profile information in profiles that were previously obtained 
from the user, along with the new profile data that was obtained 
from the user in the update 12 6 process. The new profile 
information stored 130 as a new tag for the individual for the 
particular product that is currently being profiled. 

The process 25 gives clients and vendors the ability to 
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determine the customer's actual aesthetic tastes (preferences) 
and apply knowledge of these aesthetic tastes to the market. The 
interactive testing enables profile collection by testing a 
client about his aesthetic taste. The process 25 does not rely 
on an assumption that there is an agreed upon meaning to words 
used to describe aesthetic characteristics. Moreover, the 
process 25 does not need to assume that the client would actually 
know their own preferences when a style or characteristic is only 
expressed as a word. Some people may not necessarily know what 
they prefer in a verbal way, but do have preferences, that can be 
obtained through images. When faced with two different objects, 
a person can have a preference for one object or the other 
object. The client need not explain why they have a preference. 

The process 25 could use software that is written to 
train individuals as product scorers to evaluate and score 
products in each of the 12 scales and 3 levels mentioned above. 
The process 25 could teach the product scorers how to evaluate 
various criteria by giving examples for each of the different 
scales at the different levels. 

There are variations of this process 25. For example, 
the process 25 can be modified to identify architectural 
features. The process 25 can be modified to help people 
determine the architectural style their house or what 
architectural style they would like in a house. 

This variation would show clients images of components 
of houses such as doors, windows, an overall shape of a house, 
and so forth. In each case the client would pick the style of 
these components that closely matches the style of their house or 
their preference for a house. The matching engine will add up 
the features and determine what is the closest recognizable style 
for the group of components that they described. The process can 
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make recommendations as to products that would fit within that 
style. Therefore, if the client describes an aesthetic profile 
that corresponds to a Victorian house, the process will present 
e.g., doors, windows, tile, wall coverings, and so forth that fit 
5 within a Victorian house. 

The process can use an interactive text component where 
the process can describe a variety of windows for example and the 
client can query the process for advantages and disadvantages of 
the particular window versus a different window, because most 
10 styles allows for a variety of components. The process can give 
the features of the components and explain why the client might 
; , rr ,„ want to select one window over the other. 

U3 Referring now to FIG. 11, a sales analysis process 150 

is shown. The sales analysis process 150 examines sales of 
UJ15 products to determine what aesthetic considerations may have been 
rfl used by customers when purchasing the products. The process 150 

i; = y is initiated by retrieving 152 product profiles tags for all 

Q products under consideration. The products under consideration 

J can be of the same type (e.g., chairs), class (e.g., all 

Lff20 furniture) or classification (e.g., all modern furniture). The 
;;:;!? products under consideration for analysis could cut across 

product classes (e.g., lighting and furniture). In general, it 
is only necessary the product classes share at least some scales. 
The product tags are the tags as produced in accordance with the 
25 process shown in FIG. 8. 

The process 150 analyzes 154 the product tags to 
correlate scales for products that sell well and for those 
products that do not sell well. The analysis process 154 
examines tags of the products and scores the scales in the 
30 product tags of products based on the product selling history. 

The scales are ordered 158 based upon score. The results can be 
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used to give insights into future purchases by a merchant of new 
products that are strong in particular scale factors, e.g. 
highest score or products that are weak e.g., lowest scores. The 
results can be displayed to a user 160 in a client web browser. 
5 Referring now to FIG. 12, the details of the analysis 

process 154 (FIG. 11) are shown. The analysis process 154 
produces 154a a score for each corresponding field of the product 
tags by comparing the values of the fields over all product tags 
under consideration. One embodiment could use a simple 
10 arithmetic mean value to assign 154b a value in a corresponding 

field of a result vector. This process can occur over all of the 
,^ fields in the product tag. 

The result vector includes a value that indicates the 
£ average prevalence of a particular scale over a group of 

^15 products, giving a vendor insight as to which aesthetic 
ill characteristics of its products appeal to customer aesthetic 

- preferences. The individual fields in the product tags can be 

Q ordered to give an indication of the strength of the aesthetic 

preferences in making buying decisions. One technique could use 
m20 a threshold 154c to determine whether a value in the results 
%1 field is significant or not. 

The server can conduct an analysis of vendors products 
whose aesthetic attributes are stored in the database as possible 
referral choices. The server analyzes all of the products by 
25 ordering 154c produced by popularity (which were chosen most 
often) and compares 154d the profiles of the most popular 
products to the least popular products to inform the vendor as to 
which attributes contributed the most to sales. The server 16 
can also compare the attribute profile of the vendors products to 
30 the entire database of similar products to compare what product 
profiles sold best/worst in the entire category. The server 
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could also rank the vendor' s products into a variety of tiers, 
(top 25%, next 25%, lower 25%, bottom 25%) and analyze the 
attribute profiles as explained above, against the vendor's own 
products, and against all products in the same class. This 
5 . could enable a vendor to see why their top selling products did 
well, but why their middle selling products were outperformed by 
other vendors. 

The process can also analyze the sales of an off-line 
vendor by tagging their products with the aesthetically-based 
10 attribute tags. The process can analyze their sales data to 

indicate which attributes contributed most to sales. The process 

f ^ can also be used to compare data to aggregated data of similar 

products. For example, even though the vendor's top sellers have 

1^ particular attributes, the process could discover when compared 

UJ15 to data in the on-line database that other attributes could 

^ result in even higher sales. 

yj The process can also be used to publish non- 

Q commissioned, syndicated reports that can be made available on a 

;5 website, or offline by subscription or direct sale. The report 
iri20 can show the best and worst (by popularity) attribute profiles in 
;~ 5 a variety of categories. Vendors could learn what product 

features to buy, or how to redesign their product attributes to 
increase sales . 

Referring now to FIG. 13, aesthetic based searching 
25 process is shown. A client can access the server and using a 
search engine search by attribute (s) for products. The client 
enters 172 a preference in any one or all of the attribute 
scales, without using their profile. For example, using the 
scales previously listed, one could search for a chair that was: 
30 closed, curvy, complicated, machined, highly decorated, organic, 
etc. Or one could just search for playful chairs, with no other 
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attribute specified- From the choice made by the user, the 
server would compile 174 an aestetic profile tag. The matching 
process 74, 76 (FIG. 6) would work the same way as the profiling 
match, with the desired attributes being matched against the 
5 product tags. In the case of one or a couple of desired 

attributes, many products would be returned, in the case of many 
desired attributes, few or no products would be an exact match. 
In that case, the user could be asked to eliminate some 
attributes, or to accept less than perfect matches. The user 
10 could be permitted to optionally weight the desired attributes, 

in essence producing a similar profile as they would if they took 
the test. A user could specify a 100% preference for curved 
J3 form, but a 70% preference for novelty. The user could 

'%i optionally save this created profile as their primary profile, or 

UJ15 as an additional profile. 

<n This technique to produce a profile by answering 

j ^ questions concerning scales rather than taking the test would 

□ also be useful to create additional profiles, for friends or 

J relatives, or for different residences or occasions. For 
;||20 example, a user might have two residences that they would like to 
y furnish in different ways, they therefore could create a primary 

residence profile and a "beach house" profile. Depending on 
which house they were shopping for, they would call up different 
profiles. In the case of clothing or jewelry, they could create 
25 a "work", "night on the town", "casual weekend", and other 
profiles to search according to different criteria. 

Referring now to FIG. 14, an exemplary graphical user 
interface useful in the process of FIG. 13 is presented as a web 
page 200. The web page 200 includes information contained in 
30 Table 1 (see above) . The information is presented as a series of 
questions regarding each of the scales. The user is prompted to 
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select preferences. For example, as shown in the web page 200, a 
question 202 for the scale "material" has levels A-C with the 
descriptions of each of the levels thereunder. The descriptions 
within each of the levels can be links to a web page that 
5 displays a definition of the scale being tested at that level. 

Moreover, within each of the levels are boxes or 
controls. A first box 212 will launch an image of an object 
which possess the desired characteristics. Whereas, the second 
box 214 will be a control that the user can use to enter a value 
10 corresponding to its preference for that particular style. 

The graphical user interface 200 can be adapted to 
r| produce an interface for the process described in conjunction 

with FIG. 6. In this instance, the graphical user interface 
V might eliminate, for example, all the text explanations 

;;gl5 associated with each of the scales and sub-scales being tested 
ijl and would simply provide the user with one or more images that 
^ test those particular scales to which the user can respond by 

Q selecting a control that specifies "like" or "dislike" or, 

;;;|* alternatively, to which the user can respond over a range of 

jJgO preferences, e.g., by using a sliding scale control that presents 
^ a value from, e.g., one to ten. Other techniques for inputting 

the range could alternatively be used such as a text entry and so 
forth. 

Other embodiments are within the scope of the appended 

25 claims. 
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What is claimed is: 

11. A method for selecting products that occurs over a 

2 networked computer system comprises: 

3 sending a user a web page that contains questions that 

4 request preferences for scales that correspond to aesthetic 

5 features of products: 

6 receiving from a user, a set of responses from the 

7 questions that correspond to aesthetic features of products, to 

8 produce a profile preferences for scales that correspond to 
^9 aesthetic features of products. 

: 

«j 1 2. The method of claim 1 further comprising: 

W 2 compiling an aesthetic profile tag for the user based 

m 3 on the received responses for the preferences for the scales. 

P 1 3. The method of claim 1 further comprising: 

'J 2 retrieving a product aesthetic tag associated with a 

ijl 3 particular product type selected by the user, the product 

4 aesthetic tag representing aesthetic features of the product; 

5 forming a result tag that contains a value 

6 corresponding to how well aesthetic features of the product match 

7 to aesthetic preferences of the customer. 

1 4. The method of claim 1 wherein the user is presented 

2 with a graphical user interface that contains questions that 

3 illicit the information from the user. 

1 5. The method of claim 1 wherein the user is present with 

2 a graphical user interface that is a web page. 
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1 6. The method of claim 5 wherein web page includes a 

2 control for the user to enter a value corresponding to how the 

3 user rates the importance of the scale. 

1 7. The method of claim 5 wherein the web page includes a 

2 control that when selected by the user displays a picture of an 

3 item that embodies the scale. 

1 8. The method of claim 5 wherein the web page includes a 

2 description of each of the scales. 

^ 1 9. The method of claim 5 wherein the web page includes a 

J* 2 first control for the user to enter a value corresponding to how 

jjl 3 the user rates the importance of the scale; a second control that 

(ft 4 when selected by the user displays a picture of an item that 

5 embodies the scale, and a description of each of the scales 

S 1 10. A method of producing an aesthetic profile tag for a 

Lfl 2 user comprises: 

3 3 entering preferences in a plurality of attribute 

4 scales, said attribute scales providing textual indications of 

5 aesthetic features preferred by a user. 

1 11. The method of claim 10 wherein the aesthetic features 

2 include at least one of form, material, decoration, overall 

3 appearance, and novelty. 

1 12. The method of claim 10 wherein each scale is further 

2 divided into three levels. 
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1 13. A computer program product for selecting products , said 

2 computer program product residing on a computer readable medium 

3 comprises instructions for causing a computer to: 

4 receive from a user responses for preferences for 

5 scales that correspond to aesthetic features of products, wherein 

6 the computer program product produces a graphical user interface 

7 that contains questions that illicit the information from the 

8 user. 

1 14. The computer program product of claim 13 further 

2 comprising instructions to: 

3 compile an aesthetic profile tag for the user based on 
j* 4 the received responses for the scales. 

t;fl 1 15. A system for selecting products, said system 

'" M 2 comprising: 

□ 3 a computer; 

% 4 a computer program product residing on a computer 

ijl 5 readable medium comprises instructions for causing a computer to: 

6 receive from a user responses for preferences for 

7 scales that correspond to aesthetic features of products, wherein 

8 the computer program product produces a graphical user interface 

9 that contains questions that illicit the information from the 
10 user. 
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Abstract 

A system for selecting products is described. The 
system includes a computer executing a process to retrieve a 
product aesthetic tag associated with a particular product type 
selected by a customer. The aesthetic tag contains values that 
represent aesthetic features of the product and a process to form 
a result tag that contains a value corresponding to how well 
aesthetic features of the product match to aesthetic preferences 
of the customer . 
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